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(54) PICTURE ENCODER AND PICTURE DECODER 



(57) A picture encoder receives the picture element 
data of high-resolution parts pictures. A high-order layer 
encoding section (101), a second shape data generat- 
ing section (102), and a second shape data encoding 
section (103) encode the picture element data and 
shape data of high-order layers, A ck^rvn-sarnpGng sec- 

FIG. 1 



tion (104) generates low-resolution picture element 
data. A low-order layer encoding section (105). a first 
shape data generating section (106), and a first shape 
data encoding section (107) encode the picture element 
data and shape data of low-order layers. 
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Description r 
Technical Field 

[0001] The present invention relates to an image cod* 
ing apparatus and an image decoding apparatus, and 
more particularly to a : motion image coding apparatus 
for coic£hg: image data in an efficient manner and a 
motion image decoding apparatus for decoding the 
coded data generated by the motion image coding 
apparatus, used in the f ierfd of digital image processing. 

Background Art 

[0002] In irnage ^ coding, a method of superimposing 
different motion image sequences has been cbhsid- 
ered An article titled "An Image Coding ^Scheme Using 
Layered Replantation and Multi^e Temptertes" (Tech- 
recal Rep<^ pp. 99,106 (1995)) 

describes a scherne superimposing a motion image 
sequence as a background and another motion image 
sequence of a OTnriponent or part image (e.gr, video 
image of a human f igurie^or fish cut out by chromakey 
technique) as a foreground, to generate a new image 
.sequence.. • . 

[0003] FtgM2 is : a block diagram showing a coding 
apparatus and a decodng apparatus according to the 
<x>nverrtional art A pi^el data cocfeig portion 1201 in Fig. 
12 is a portk>h ^ pixel date, represent^ 

arKTcolbrd^ 
tion 1202 is for c^ 

of part image. These portions constitute an apparatus 
for cocTrig a part image 

[0004] Shape data aJe used lor coding pixel data. A 
pixiBl data ctecocfing portion 1203 in Fig. 12 is a portion 
for decoding pixel data; and a shape data decoding por- 
tion 1204 is-lbrdeaxthg shape data; These portions 
constitute an apparatus for decoding a part image. For 
decoding pixel data, decoded shape data are used. 
[0005] Shape data coding portion 1202 first expresses 
a contour of a shape using 8 directional chain codes, for 
example, and then codes the chain codes by Huffman 
coding, Pixel date coding portion 1201 codes pixel data 
by the internatic^ ^ of coding motion 

images, such as W?EG ix JH.261, When pixel data are 
divided into blocks, ah arbitral? shape DCT technique 
or the like is employed for the block including abound- 
aryof part image. ^ 

[0006] Each part image is decoded by a decoding 
apparatus, and ^en supemposed at a superimposing 
portion (not shown) fusing shape data, and dteptayed on 
a de/ice like a display. For example, when superimpos- 
ing a part image p (t. in arbitrary shape on a rectangu- 
lar background image b fi. D. a cfispfay image f (i. D is 
generated using shape data s (i. D according to the fol- 
lowing expression (1): 

f(i. i)=Pf'. j) sO J) + bC. j)[l-s<i. j)] (1) 



wherein (i; j) represents a coordinate of a pixel, and f (i, 
j) represents a pixel value, s (i. j") assumes the value "1 " 
within a part image, and "0" outside the part image. 
[0007] In the conventional art, however, there has not 
5 been proposed a technique for setting up spatial hierar- 
chy for a part image. The international standard MPEG2 
method realizes hierarchy O e., spatial hierarchy) over 
an entire image. In the method, data in a lower layer 
having low spatial resolution throughout the entire 
ic image and data in an upper layer for improving the res- 
olution are decoded together to achieve high spatial res- 
olution. 

[0008] Accordingly, an object of the present invention 
is to provide an image cocfing apparatus and an image 
decoding apparatus that can realize spatial hierarchy in 
a part image. 

[0009] To obtain shape date of low resolution, high- 
resolution shape data obtained by the conventional art 
may simply be thinned out However, if thus obtained 
low-resolution image is displayed on a large-screen 
monitor having low resolution, the contour of a part will 
have stepwise appearance, which leads to deterioration 
in psychic image quality. The same problem arises 
when a low-resolution image is enlarged for cfi splay on a 
large-screen monitor having high resolution: 
[0010] Accorcftngty. another object of the present 
invention is to provide an image cocing apparatus and 
an image decoding apparatus that can solve the above 
problem. 

Disclosure of the Invention 

[001 1 J In the present invention, an image coding 
apparatus and an image de<xxfing apparatus as 
35 described in theficte^ 

to solve the abcve-described problems. 

(1) An image coding apparatus performing tower 
layer coding for coding a part image in arbitrary 

4c shape b low resolutkxi 

coding the part image in high resolution, compris- 
ing: a first shape date generating pcrtxxi for gener- 
ating low-resolution shape data representing the 
arbitrary shape; a first shape data coding portion for 
45 coding the generated low-resolution shape data; a 
second shape data generating portion for generat- 
ing high-resolution shape data representing the 
arbitrary shape; and a second shape data cocing 
portion for cocfing tie generated high-resolution 
so shape data; wherein the tow-resolution shape data 
are used for coding the part image in the lower 
layer, and the Ngfvresolution shape data and tie 
decoded part image data in the lower layer are 
used for cocfing the part image in the upper layer. 

(2) The image cocfing apparatus accorcfing to (1). 
wherein the second shape data cocfing portion 
codes information on difference between the high- 
resolution shape data and the low-resolution shape 
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data. 

(3) An image coding apparatus performing tower 
layer coding for coding a part image in arbitrary 
shape in low resolution and upper layer coding for 
coding the part image in high resolution, wherein s 
high resolution shape data of the part image are 
shared by the upper and lower layers; the appara- 
tus comprising a high-resolution shape data gener- 
ating portion for generating high-resolution shape 
data of the part image, and a shape data coding io 
portion tor coding the generated high-resolution 
shape data; wherein high resolution shape data 
having N levels of gradation (N is at least 2) are 
transformed to low-resolution shape data having M 
levels of gradation (M>N). the low-resolution shape is 
data are used for coding the part image in the lower 
layer, and the high-resolution shape data and the 
decoded part image data in the lower layer are 
used for coding the part image in the upper layer. 

(4) An image-decoding apparatus for decoding data zo 
coded by the image coding apparatus according to 

(1) , performing lower layer decoding for decoding a 
part image in arbitrary shape in low resolution and 
upper layer decoding for decoding the part image in 
high resolution; the apparatus comprising: a first 25 
shape data decoding portion for decoding low-reso- 
lution shape data, and a second shape data decod- 
ing portion for decoding high-resolution shape data; 
the low-resolution shape data are used for decod- 
ing the part image in the lower layer, and the high- 30 
resolution shape data and the decoded part image 
data in the lower layer are used for decoding the 
part image in the upper lay©-. 

(5) An image decoding apparatus for decoding data 
coded by the image cocfing apparatus according to 3s 

(2) , performing lower layer decocfing for decoding a 
part image in arbitrary shape in low resolution and 
upper layer decoding for decoding the part image in 
high resolution; the apparatus comprising: a first 
shape data decoding portion for decoding tow-reso- 40 
lutton shape data, and a second shape data decod- 
ing portion for decoding high-resolution shape data; 
wherein the low-resolution shape data are used for 
decoding the part image in the lower layer, and the 
high-resolution shape data and the decoded part 45 
image data in the lower layer are used for decoding 
the part image in the upper layer; and the second 
shape data deooding portion uses information on 
difference between the high-resolution shape data 
and the low-resolution shape data to obtain high so 
resolution shape data. 

(6) An image decoding apparatus for decocfing data 
coded by the image coding apparatus according to 

(3) . performing lower layer decocfing for decoding a 
part image in arbitrary shape in tow resolution and 55 
upper layer decoding for decoding the part image in 
high resolution; wherein high resolution shape data 

of the part image are shared by the lower and upper 



layers; the apparatus comprising a shape data 
decoding portion for decoding high-resolution 
shape data; wherein high resolution shape data 
with N levels of gradation (N is at least 2) are trans- 
formed to low-resolution shape data with M levels of 
gradation (M>N), the transformed shape data are 
used for decoding the part image in the lower layer, 
and the high-resolution shape data and the 
decoded part image in the lower layer are used for 
decoding the part image in the upper layer. 

(7) The image coding apparatus according to (1). 
wherein the second shape data generating portion 
has a mode lor generating high-resolution shape 
data corresponding to a portion of the part image 
coded in the lower layer. 

(8) The image coding apparatus according to (2), 
wherein the second shape data generating portion 
has a mode for generating high-resolution shape 
data corresponding to a portion of the part image 
coded in the lower layer, and when the mode is 
selected, the second shape data coding portion 
codes the high-resolution shape data independent 
of the low-resolution shape data. 

(9) An image deooding apparatus for decoding data 
coded by the image coding apparatus according to 
(7), performing lower layer decoding for decoding a 
part image in arbitrary shape in low resolution and 
upper layer decoding for decoding the part image in 
high resolution; the apparatus comprising: a first 
shape data decocfing portion for decoding low-reso- 
lution shape data, and a second shape data decod- 
ing portion for decocfing high-resolution shape data; 
wherein the low-resolution shape data are used for 
decoding the part image in the lower layer, and the 
high-resolution shape data! and the decoded part 
image data in the lower layer are used for decocfing 
the part image in the upper layer; and the second 
shape data decoding portion has a mode for decod- 
ing high-resolution shape data corresponding to a 
portion of the part image coded in the lower layer. 

(10) An image decoding apparatus for decocfing 
data coded by the image coding apparatus accord- 
ing to (8). performing lower layer decoding for 
decoding a part image in arbitrary shape in low res- 
olution and upper layer decocfing for decocfing the 
part image in high resolution; the apparatus com- 
prising: a first shape data decocfing portion for 
decoding low-resolution shape data, and a second 
shape data decoding portion for decocfing high-res- 
olution shape data; wherein the low-resolution 
shape data are used for decoding the part image in 
the lower layer, and the high-resolution shape data 
and the decoded part image data in the lower layer 
are used for decocfing the part image in me upper 
layer; the second shape data decoding portion 
uses information on difference between the high- 
resolution shape data and the low-resolution shape 
data to obtain high-resolution shape data; and the 
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second shape data decoding portion has a mode 

for decoding high-resolution shape data coirre- 

sponding to a portion of the part image coded in the 

lower layer, :and, when the mode is selected, 

decode^nejhig^^ 

ent of the ^ iwHPesolution shape data 

Brief Description of the Drawings 

[0O12] ■/ 

Fig 1 is a Wock diagram showing a coding appara- 
tus according jq a fir^ embodiment of the present 
■ " --inventiOT^^ 

Fig. 2 t^a bld«ck diagram showing a decoding appa- 
ratus^ aocoidir^ embddirmnt of the 
priesent irWenl^." 

Rg 3 ts a block diagram showing a coding appara- 
tus ac^ding ;tb a second embodirnent of the 
present invention. :\\ 

Fig. 45is a Wock diagram showing a decoding appa- 
ratus according to the second embodiment of the 
presehttinvention. 

Fig. 5 is aBock diagram showing a oodrig appara- 
tus aaxirt^^ embocfiment of the present 

Fig. 6 is; a block diagram showing a decoding appa- 

rahs^a^bw^ 

im^ of the p^ 

Fkj. 7 is a (fiagram for use in illustrating information 
ondirte^^ and 
tower la^ sh^>e data: : ; . 
Fig^ 8A through 8D are diagrams for use in iBus- 
tr^ng a technk^ue for obtaining tow^escOution 
shape date from rugh-resplutton shape data 
according to tr^ present invention. 
Fi^ 9 is a 

tus accortf^ embodiment of the present 

. invention. - r 
Fig. 10 is a block cfiagram showing an example of 
an apparatus for perform^ 
part image according to the present invention. 
Fig. 11 is a block diagram showing a tower layer 
decoding apparatus according to the present inven- 
tion. 

Fig. 12 is a block diagram showing a coding appa- 
ratus and a decocing apparatus in the conventional 

Best Mode for Carrying Out the Invention 

[0013] Hereinafter, embodiments of the present inven- 
tion witt be described, though the present invention is 
not Emited to those embodiments. 
[0014] An apparatus shown in Fig. 10 is considered as 
means for setting up spatial hierarchy in a part image. A 
down sampling portion 1001 in Fig. 10 thins out pixels 
from input pixel data to lower spatial resolution of the 



pixel data. A second down sampling portion 1002 thins 
out pixels from input shape data to lower spatial resolu- 
tion of the shape data. The shape data show a shape of 
pail image, and are represented as a binary image hav- 
5 ingia^jxel value "1" within a part and a pixel value "0" 
outside 'the part, for exarnple. 

[0015] A lower layer coding portion 1004 codes pixel 
data of low resolution. For the coding, the international 
standard method of coding motion images, such as 

ic MPEG or H.261 , is employed. When an image is divided 
into blocks, an arbrtrary shape OCT technique or the like 
is used for a block including a boundary of part image, 
in this case, lw-re^lu^ data output from sec- 
ond dpvvn sampling portion 1002 are used as inferma- 

15 tkxi cri trie bour^ 

[0016] Ah upp^ portion 1 003 cbdes pixel 

data 6f high resolution, in which the irrtemationai stand- 
ard method of motion kreige coding such as MPEG or 
H.261 is also employed. Here, prediction from the 

20 decoded images in the lower layer as well as in the 
upper layer is employed. For the boundary of the part 
image, high-resolution shape data that have not been 
down sampled are used. 

[0017] A shape data coding portion 1005 codes shape 

25 data of high resolution that corresponds to the resolu- 
tion of the upper layer. The contour of a shape is 
expreissed with 8 directional chain codes; lor example, 
and these chain cod^ are cod^ by Hu^ 
[0018] The cxrted date ^ 

3C portion (not shown), and b aift>i n Ued or stored. In a 
jdecocfing apparatus fcr decochng only a as 
shown in.Fig. I T, onry the ctete n^^ decoding 
the lower layer are picked up from the coded data hav- 
ing thora fdr th^ 

35 therein, and are used for the decocing process. In other 
words, "coded date of fie loww layer pbtel date and 
*coded data of tie shape data" are selected at a selec- 
tion portion (hot shown) and decoded. 
[0019] At time, a shape ctete decxxhng pcrbon 

Ac 1 103 in Fig. ir decodes high-resolution shape data 
Low-resolution shape date ob^ned h a ctown sam- 
pting portion 1 102, using the same technique as in sec- 
ond down sarnptsng portion 1002 of Fig. 10. Thus 
obtained data are used lor decoding pixel data in a 

45 lower layer decocing portion 1101. A decoding appara- 
tus for decoding up to an upper layer uses all the coded 
data to conduct decocfing up to the upper layer. 
[00201 However, the above-described apparatus suf- 
fers the following problem. That is, though conventional 

so decocting of a lower layer only requires shape data of 
low resolution, the above apparatus has to use high-res- 
olution shape data when coding date in the lower layer, 
which results in redundant data in other words, shape 
data in an upper layer having a large amount of codes 

55 should be used instead of shape date in a lower layer 
with a less amount of codes. Therefore, it becomes dif- 
ficult to code a lower layer in good image cpjafity with a 
imited transmission or storage capacity. 
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[0021] The first and second embodiments of the 
present invention aim to solve this problem. 
[0022] Figs. 1 and 2 are block diagrams respectively 
showing a coding apparatus and a decoding apparatus 
according to the first embodiment. 
[0023] Referring to Fig. 1. a down sampling portion 
104 thins out input pixel data to generate low-resolution 
pixel data for a lower layer. When thinning out, a low 
path fitter is used to prevent aliasing. A lower layer cod- 
ing portion 105 codes the low-resolution pixel data. 
[0024] For coding, the internationally standardized 
method of coding motion images, such as MPEG or 
H.261. is employed. When an image is divided into 
blocks, an arbitrary shape OCT technique or the Ske is 
employed for a block including a boundary of part 
image. For the boundary of the part image, low-resolu- 
tion shape data output from a first shape data generat- 
ing portion 106 are used. 

[0025] First shape data generating portion 1 06 gener- 
ates low-resolution shape data for a lower layer. Shape 
data are extracted by dividing pixel data into areas, for 
exanrple. Techniques used for the area dividing include 
an edge detecting technique using differential opera- 
tion, and morphological segmentation. 
[0026] When cutting out a shape of moving object 
from a static background, dynamic area detection using 
intra-frame differences can be utilized. Alternatively, 
shape data can be generated by chromakey technique. 
In Fig. 1 . low-resolution shape data are obtained after 
thinning out target pixel data in a down sampling portion 
104 to lower the resolution thereof. However, another 
method may be employed in which shape data are first 
obtained for high-resolution pixel data, and the shape 
data are then thinned out to obtain low-resolution shape 
data. 

[0027] The shape data generated here are binary 
images or images having two or more levels of grada- 
tion. In the latter case, superimposition of a part image 
and a background image according to the above 
expression (1) can be considered as weighted mean of 
the part image and the background image with the 
shape data being a weight. Note that the shape data s 
(i, j) in the expression (1) takes a value "1" within the tar- 
get part image, "0" outside the part image, and a value 
between TT and "1" at the boundary portion of the part 
image. 

[0028] A first shape data coding portion 107 codes 
low-resolution shape data for a lower layer. If the shape 
data are binary data, run length coding, MMR coding, 
chain coding, or the like is used lor the coding. If the 
shape data are expressed with two or more tasels of 
gradation, a coding scheme using DCT as in MPEG, a 
coding scheme using a quaternary tree and vector 
quantization ("MPEG-4 Video Verification Model Ver- 
sion 2.0 W (1SO/IECTC1/SC29/WG1 1 N1260)). or the like 
is used. 

[0029] A second shape data generating portion 102 
generates high-resolution shape data for an tpper layer 



from high-resolution pixel data. The method of generat- 
ing the shape data is same as in the first shape data 
generating portion 106. and therefore, description 
thereof is not repeated. A second shape data coding 

5 portion 103 codes the high-resolution shape data gen- 
erated by second shape data generating portion 102. 
The method of coding the shape data is same as in the 
first shape data coding portion 107, and description 
thereof is not repeated. Note that those two shape data 

to coding portions 103, 107 do not have to use the identi- 
cal coding method; they may use separate methods for 
coding, instead. 

[0030] An upper layer coding portion 101 codes high- 
resolution pixel data. Thecocfing is performed using the 

is international standard method of coding motion images, 
such as MPEG or H.261 , as in the technique described 
in the Background Art section. Herein, however, the 
coding utilizes prediction from partially decoded images 
existing in lower layer coding portion 105 in addition to 

20 prediction from decoded images preceding or succeed- 
ing in time in the upper layer. For the boundary of part 
image, high-resolution shape data output from second 
shape data generating portion 102 are used. 
[0031] Next, a decoding apparatus according to the 

25 first embodiment will be described with reference to Rg. 
2. 

[0032] A lower layer decoding apparatus 205 consists 
of portions surrounded by a broken line in Fig. 2. A first 
shape data decocfng portion 204 decodes coded data 

30 of the lower layer shape data to obtain low-resolution 
shape data. The decoded shape data are sent to a 
lower layer decocfng portion 203. and are also used for 
display of a lower layer image Lower layer decocfng 
portion 203 decodes coded data of the lower layer pixel 

35 data, and supplies low-resolution pixel data to a lower 
layer display portion (not shewn). 
[0033] Next decocfcng of an upper layer in Rg. 2 will 
be described. A second shape data decoding portion 
202 decodes coded data of the upper layer shape data 

40 to obtain high-resolution shape data. The decoded 
shape data are sent to an upper layer decoding portion 
201 , and also used for display of an upper layer image. 
[0034] Upper layer decoding portion 201 decodes 
coded data of the upper layer pixel data, and supplies 

45 high-resolution pixel data to an upper layer display por- 
tion (not shown). Upper layer decoding portion 201 uti- 
lizes, as in the upper layer cocfing portion 101 shewn in 
Rg. 1, prediction from the decoded images in lower 
layer decoding portion 203 in addition to prediction from 

so the decoded images preceding or succeeding in time in 
the upper layer. 

[0035] The second embocfiment of the present inven- 
tion will now be described. 

[0036] In the first embodiment described above, high- 
55 resolution shape data used in an upper layer and low- 
resolution shape data used in a lower layer are coded 
independent of each other. Thus, infor ma t i on on the 
shape data in the lower layer is not reflected to coding of 
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the shape data in the upper layer, and therefore, an 
amount of codes of the shape data in the upper layer 
becomes target This leads to a problem that a total 
amount of codes for the upper layer increases than in 
the case where the methods shown in Figs. 10 and 1 1 s 
are employed. Acppirdingi^ this embodiment aims to 
solve the above problem by coding only information on 
the difference between low-resolution shape data and 
high-resoliition shape data. 

[0037] Figs. 3 and;4 are blbck diagrams respectively ic 
showing a coding apparatus and a decoding apparatus 
according to the second embodiment. 
[0038] vThe coding apparatus in Fig. 3 differs from the 
coding apparatus in Fig. 1 in that lew-resolution shape 
data in a first shape data coding portion 307 are sent to 75 
a second shape data coding portion 303, and the sec- 
ond shape data coding portion 303 codes only informa- 
tion on the difference between the low^esolution shape 
data and the high:* €^utton shape data. 
[0039] Other than that, upper layer coding portion 101, 20 
second shape data generating portion 102, down sam- 
pling portion 104, lower layer coding portion 105, and 
first shape data generating portion 106 are the same as 
those in Fig. 1 . and therefore, description thereof is not 
repeated.' 25 
[0040] The decoding apparatus in Fig 4 is different 
from the decb^ in Fig. 2 in that tow-resolu- 

tion shape data decoded in a first shape d 
portion 404 are sent to a^^ 

portion 402, ^ second shape data decocfing por- 3C 
tid«;402~decS 

the in for ma t io n on ftfte dfflfeence. ; 
[0041] Other than that, upper layer decoding portion 
201 arid tower layer decoding portion 203 are same as 
those th Fig. 2, arid trwetere, description thereof is not as 
repeated. -In actftion. a lower layer decoding apparatus 
405 is equivalent to lower layer decoding apparatus 205 
in Fig. 2. ^ " 

[0042] When a quaternary tree is used for represent- 
ing binary shape data, for example, data in the lower 40 
hierarchies of the tree may be used as the above- 
described informatibh on the difference. Fig. 7 shows 
binary shape data and exemplary quaternary tree r ep- 
reserrtation thereof. The uppermost value of the quater- 
nary tree is "1" when at least one pixel value "1" exists 45 
within a block of 4 pixels by 4 pixels, or "0" otherwise. 
Values at the second and the third hierarchies of the 
tree are likewise determined for blocks of 2 pixels by 2 
pixels and of 1 pixel by 1 pixel, respectively. 
[0043] Blocks at respective hierarchies are scanned so 
from above left to below right in a raster scan sequence. 
In the example shown in Fig: 7, the shape data in the 
upper layer are expressed with three hierarchies, and 
the shape data in the lower layer are expressed with two 
hierarchies. The data in the third hierarchy is expressed ss 
as the information on the difference between the upper 
and lower layers. These data expressed with the quater- 
nary tree are coded by arithmetic coding, for example. 



[0044] When the shape data are expressed with two 
or more layers of gradation, another coding method may 
be employed, in which tow-resolution shape data are 
up-sampled to the resolution for an upper layer before 
taking the difference with high-resolution sh^>e data, 
and the difference data are then coded by transforma- 
tion coding. 

[0045] Next, the third embodiment of the present 
mention will be described. 

[0046] In the methods described with reference to 
Figs. 10 and 1 1 as above, low-resolution shape data are 
obtained by thinning out shape data. This may cause a 
problem that the contour of a part image in the lower 
layer becomes stepwise, which results in degradation of 
the image quality. 

[0047] In the third enrtxxdiment, the above problem is 
solved by setting up for shape data more layers of gra- 
dation than in the original shape data, along with thin- 
ning out of the shape data. 

[0048] Fig. 8A shows a part of binary shape data. Rg. 
8B shows exemplary shape data tra nsf ormed to be 
adapted to a low-resolution monitor of which the resolu- 
tion is halved and the pixel size is doubled both verti- 
cally as well as horizontally. In this example, a 2 x 2 
filter, 



0.25 


0.25 


0.25 


0.25, 



is applied to a block surrounded by a bold tine in Fig. 8A, 
thereby obtaining tow-resolution shape data having five 
levels of gradation of 0, 0 25. 0.5, 0 75, and 1 . When an 
element of the above 2 x 2 filter is represented as f (i, j) 
and an element within a block in Fig. 8A is represented 
as d (i. j"). the filtering operation can be represented as 
follows: 

2f(U)d(i.D 

wherein I represents a sum for i=1, 2 and j=1, 2. If the 
ori g inal shape data has N levels of g radation, the titer- 
ing allows generation of shape data with M(M>M) levels 
of gradation. 

[0049] Ftg. 8C shows exemplary shape data used for 
enlarging a part image of lew resolution for cftsptay on a 
monitor tfiat allows display with the same resolution as 
in Fig. 8 A. The data can be obtained by simply enlarging 
the data in Fig. SB by a factor of 2 verticaly as well as 
horizontally. Increasing the number c* levels of grada- 
tion of the shape data in low resolution as described 
above can avoid the stepwise appearance of the bound- 
ary portion 

[0050] The shape data generated in Rg: 8CX for exam- 
ple, can be used for superirrposing m 
the expression (1 ) described in the Background Art sec- 
tion. In this case, the background and the foreground 
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are mixed at the contour portion of a part image, 
thereby making the stepwise pattern at the boundary 
inconspicuous. 

[0051] Though the above example has been 
described using a 2 x 2 filter, other filters may be 5 
errployed, instead. For example, a 3 x 3 filter as follows 
can be used to transform shape data into a vertically as 
well as horizontally halved version. 
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[0052] Here, target pixels for sub-sampling are, for 
example, those shown by • in Fig. 8(d). 
[0063] Figs. 5 and 6 are block diagrams respectively 
showing a coding apparatus and a lower layer decoding 20 
apparatus according.to the third embodiment. They are 
modifications of those that are shown in Figs. 10 and 
1 1 , with the portions for down sampling the shape data 
being replaced by transforming portions 504 and 602. 
respectively. 25 
[0054] Other than that first down sampling portion 
1001 , upper layer coding portion 1003. lower layer cod- 
ing portion 1004. shape data coding portion 1005. lower 
layer decoding portion 1101. and shape data decoding 
portion 1 1 03 are same as those in Rgs. 1 0 and 1 1 . and 30 
therefore, description thereof is not repeated. 
[0055] Transferrers 

ating identical to each other, transform shape data into 
the ones having lower resolution but more levels of gra- 
dation, as shown in Fig. 8. 

[0056] Though a 2 x 2 filter has been used in Figs. 8A 
- 8C, many other fitters, such as those of 3 x 3 or 2 x 5. 
can also be used for transformation. 
[0057] Furthermore, in the description of the coding 
apparatus according to the above embodiments, shape 
data sent to the shape data coding portion have also 
been sent to the corresponding pixel data coding por- 
tion. In that case, however, a problem will arise when 
nonreversfcle coding is performed in the shape data 
coding portion, because the shape data used in a pixel 
data coding portion and the shape data used in a pixel 
data decoding portion in a decoding apparatus become 
different from each other. 

[0058] In such a case, the coding apparatus may be 
provided with a shape data decoding portion, so that the 
coded shape data can be decoded in the shape data 
decoding portion before being sent to the correspond- 
ing pixel data coding portion. Fig. 9 shows a variation of 
the coding apparatus in Fig. 3. which has been modified 
in this manner. 

[0059] Referring to Fig. 9, decoded data of the lower 
layer shape data that have been decoded by a first 
shape data decocfing portion 909 are sent to a lower 
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layer coring portion 905 as well as to a second shape 
data coding portion 903 and a second shape data 
decoding portion 908. A decoding apparatus corre- 
sponding to the coding apparatus shown in Fig. 9 also 
uses the decoded data of lower layer shape data at an 
upper layer shape data decoding portion, that is a por- 
tion equivalent to the second shape data decoding por- 
tion 908 in Fig. 9. 

[0060] Finally, the fourth embodiment of the present 
invention will be described. 

[0061 ] The present embodiment is based on the first 
and second embodiments, but in which an upper layer is 
configured to improve spatial resolution of only a portion 
of part image coded in the lower layer. By this configu- 
ration, an area for a face of a figure can be coded as a 
part image in the lower layer, and only the mouth portion 
can be coded in high resolution in the upper layer, for 
example. 

[0062] When the fourth embodiment is adapted to the 
first embodiment, the second shape data generating 
portion 102 of the coding apparatus shown in Fig. 1 can 
be used to generate high-resolution shape data corre- 
sponding to a portion of part image, and thus the 
present invention can be i m plemented: 
[0063] As a decocfing apparatus corresponrJng 
thereto, the apparatus shown in Fig. 2 can be used as it 
is. Likewise, when this embodiment is adapted to t£e 
second embodiment the high-resolution shape data 
corresponding to a portion of part image can be gener- 
ated by the second shape data generating portion 102 
of the coding apparatus shown in Fig. 3. whereby fie 
present invention can be im p l em en ted. 
[0064] In this case, however, a signal line from the first 
shape data coding portion 307 to the second shape 
35 data coding portion 303 is not used Therefore, there is 
a need to provide a swftch to switch between the meth- 
ods described in the fourth and second embodiments. 
This switch is provided between the first shape data 
coding portion 307 and the second shape data coring 
40 portion 303. When using the method according to the 
fourth embodiment, the switch is turned off and the 
upper layer shape data (the second shape data) are 
coded independently. When using the method as 
described in the second embodiment the switch is 
45 turned on and the information on the difference between 
the upper layer shape data (the second shape data) and 
the lower layer shape data (the first shape data) are 
coded. 

[0065] For a decocfing apparatus, the apparatus 
so shown in Fig. 4 is provided with a similar switch, which 
is tfsposed on a signal fine connecting the first shape 
data decoding portion 404 and the second shape data 
decoding portion 402 in Fig. 4. The switch, as with the 
switch in the coding apparatus, controls switching 
55 between the case in which the upper layer shape data 
(the second shape data) are decoded independently, 
and the case in which the data representing the differ- 
ence between the upper layer shape data (the second 
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shape data) and the lower layer shape data (the first 
shape data) are ^ difference data 

are added to the lower layer shape data (the first shape 
data) to decode the upper layer shape data (the second 
shape data)/ /: ; : ; ; j . ~ 

[006(6] According to the motion image coding appara- 
tus and the rm)tk>n image decoding apparatus accord- 
ing to the above embodiments, the following favorable 
effects can be curtained: 

(1) CocHngjand decoding of a part image having 
spatial hierarcary can be realized,; 

(2) in the first : etrt)6d\tv^ low-resolution shape 
data are coded as the shape data for a lower layer. 

... Acx^brdirigiyr redurKlark^^ associated with coding of 
high-resolution shape date in the lower lay er can be 

" &iminatec^ in the lower layer 

can be coded and decoded in desirable image qual- 
ity, even with limit^ trans^^ capac- 
ity. . \.' y-s^'v^X.^. V- 

(3) In the second ernbodiment, information on the 
..shape data in the lower layer is used for coding the 

shape data in i the up^rr layer, ar^ 
the difference between the tow-resoliiion shape 
data and the high-resolution shape data is coded. 
Accordingly, data amount necessary for coding the 
shape data in the iwer layer can be reduced, 
j -Therefore, efficient' coding can be realized infthe 
. upper layer. 
^(4)Llnthe^ shape data 

are tran^rned to generate 1^ shape data 

haying more * levete ; of gradation. Accordingly, Jthe 
stepwise boundary existing in the contour portioh of 
lower layer shape data can be made inconspicu- 
ous. Therefore; ^ contour of a part image on dis- 
play becomes ismbbft^ arid thus a psychically 
fovor^e iiroge ran be obtained. 
(5) In another emtodim^ present invention, 
assuming that the upper layer shape data are 
..... smaller than the lower layer shape data, hierarchi- 
cal coding for improving spatial resolution of a part 
of to tower layer using data in the upper layer can 
be performed. AcxzKCfngry, if there is a need to look 
into the contents of an image only in a portion of the 
lower layer; or H only a portion in the lower layer has 
a complex texture and has to be displayed in high 
resolution, it is possible to perform an appropriate 
hierarchical coding. 

Industrial AfxtfcabilHy 

[0067] As described above, the present invention ena- 
bles efficient cocfing and decoding of a part image hav- 
ing spatial hierarchy. Accordingly, the present invention 
is advantageously applicable to the field of image cod- 
ing and decoding apparatuses. 



Claims 

1. An image coding apparatus performing lower layer 
coding for coding a part image in arbitrary shape in 

5 low resolution and upper layer coding for coding the 
part image in high resolution, comprising: 

a first shape data generating portion (1 06) for 
generating Idw+esolutfon shape data repre- 

ic senting the arbitrary shape; 

a first shape data coding portion (107) for cod- 
ing the generated low-resolution shape data; 
a second shape data generating portion (102) 
for generating higrvresolution shape data rep- 

15 resenting the arbitrary 

a second shape data coding portion (103) for 
coding the generated high-resolution shape 
data; wherein 

said low-resolution shape data are used for 
20 coding the part image in the lower layer, and 

said NgfWesbiution shape data and said 
decoded part image data in the tower layer are 
used for coding the part image in the upper 
layer. 

25 ■ ■ .. ' ' ' 

2. The image cocfing apparatus according to claim 1 , 
wherein Vsaid second shape data coding portion 
codes information on difference between said high- 
resolution shape data and said low-resolution 

30 shape data. 

3. An irrage cocfing apparatus perfomvng tower layer 

oxfingforcxic^a^^ 
taw resolution arrf 
35 part image in high resolution, wherein 

high-resotution shape data of said part image 
are shared by tie upper and lower layers; tie 
image axing apparatus comprising: 
40 a high-resolution shape data generating por- 

tfon for generating high-resolutjon shape data 
of said part Image; and 

a shape data coding portion (105) for coding 
the generated high-resolution shape data; 

45 wherein 

said high-resolution shape data having N levels 
of gradation (N is at least 2) are tr an sforme d to 
low-resolution shape data having M (M>N) lev- 
els of gradation, 

so said Icw-r es otu feon shape data are used for 

coding the part image in the lower layer, and 
said rugrwesofcftfon shape data and decoded 
part image data in the lower layer are used for 
coding the part image in the upper layer. 

55 

4. An image decocfing apparatus for decocfing data 
coded by the image coding apparatus accorcfng to 
claim 1 , performing 
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6. 



lower layer decoding for decoding a part image 
in arbitrary shape in tow resolution arid upper 
layer decoding for decoding the part image in 
high resolution; the image decoding apparatus 
comprising: 

a first shape data decoding portion (204) for 
decoding low-resolution shape data; and 
a second shape data decoding portion (202) 
for decoding high-resolution shape data; 
wherein 

said low-resolution shape data are used for 
decoding the part image in the lower layer, and 
said high-resolution shape data and decoded 
part image data in the lower layer are used for 
decoding the part image in the upper layer. 

An image decoding apparatus for decoding data 
coded by the image coding apparatus according to 
claim 2, performing 

lower layer decoding for decoding a part image 
in arbitrary shape in lew resolution and upper 
layer decoding for decoding the part image in 
high resolution; the image decoding apparatus 
comprising: 

a first shape data decoding potion (404) tor 
decoding bw-resolution shape data; and 
a second shape data decoding portion (402) 
for decoding high-resolution shape data; 
wherein 

said low-resolution shape data are used tor 
decoding the part image in the lower layer, and 
said high-resotution shape data and said 
decoded part image data in the lower layer are 
used for decoding the part image in the upper 
layer, arid 

said second shape data decoding portion (402) 
uses information on difference between said 
high-resolution shape data and said low-reso- 
lution shape data to obtain shape data in high 
resolution. 

An image decocting apparatus for decoding data 
coded by the image coring apparatus according to 
claim 3, performing 

lower layer decoding for decoding a part image 
in arbitrary shape in low resolution and upper 
layer decocting for decocting the part image in 
high resolution, wherein 
high-resolution shape data of said part image 
are shared in the lower and upper layers; the 
image decoding apparatus comprising: 
a shape data decocting portion (1103) tor 
decoding high-resolution shape data; wherein 
said high-resolution shape data having N (N is 
at least 2) levels of gradation are transformed 
to low-resolution shape data having M (M>N) 



levels of gradation. 

said transformed shape data are used for 
decoding the part image in the lower layer, and 
said high-resolution shape data and said 
5 decoded part image in the lower layer are used 

for decoding the part image in the upper layer. 

7. The image coding apparatus according to daim 1 , 
wherein said second shape data generating portion 

10 (102) has a mode for generating high-resolution 
shape data corresponding to a portion of the part 
image coded in the lower layer. 

8. The image coding apparatus according to claim 2, 
is wherein said second shape data generating portion 

(102) has a mode for generating high-resolution 
shape data corresponding to a portion of the part 
image coded in the lower layer, and 

20 when said mode is selected, said second 

shape data coding portion codes said high-res- 
olution shape data independent of said low- 
resolution shape data. 

25 9. An image decoding apparatus for decoding data 
coded by the image coding apparatus according to 
daim 7, perforrring 

lower layer decocting for decoding a part image 
30 in arbitrary shape in low resolution and upper 

layer decoding for decocting the part image in 
high resolution; the image decoding apparatus 
comprising: 

a first shape data decoding portion tor decod- 
35 ing low-resolution shape data; and 

a second shape data decoding portion for 
decoding high-resolution shape data; wherein 
said low-resolution shape data are used for 
decoding the part image in the lower layer, and 
40 said high-resolution shape data and said 

decoded part image data in the lower layer are 
used for decoding the part image in the upper 
layer, and 

said second shape data decoding portion has a 
45 mode for decoding high-resolution shape data 

corresponding to a portion of the part image 
coded in the lower layer. 

10. An image decocting apparatus for decocting data 
so coded by the image coding apparatus according to 
daim 8, performing 

lower layer decocting for decoding a part image 
in arbitrary shape in low resolution and upper 
55 layer decoding for decocting the part image in 

higfr resolution; the image decoding apparatus 
comprising: 

a first shape data decocting portion for decod- 
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ingiibwirescrfi^^ shape data; and 
a : second; shape data decoding portion for 
decc*iiin^ shape data; wherein 

low : reso<ution shape data are used tof decod- 

ii^;^ 5 
hjgti^ decoded 
part;jn^ 

de^ing the part image in the upper layer, 
said -second shape ; data decoding portion 

V ctotein^ shape data :by using ic 

information on difference between said high- 
resolution shape data and said low -resolution 
shape data^and ' '"'v- / • : - 

said second shape data decoding portion has a 
modie fc^d^ resolution shape data 15 

cbrresporiding tb a portion of the part image 
boded in the lower layer, and, when said mode 

: ts" selected, decodes said high-; resolution 
shape data independent of saki low-resolution 
shape data. 2c 
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FIG.8B 
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